Skip to content

Forge invoke#4671

Draft
koopmant wants to merge 4 commits into
mainfrom
forge-invoke
Draft

Forge invoke#4671
koopmant wants to merge 4 commits into
mainfrom
forge-invoke

Conversation

@koopmant
Copy link
Copy Markdown
Contributor

Closes #4669

@koopmant
Copy link
Copy Markdown
Contributor Author

I still had this branch from some time ago. It has (almost?) everything. I was still trying to improve the test_run script to only start the container once and invoke the model multiple times; right now it restarts the container for each interface.

I had not yet figured out how to deal with the inputs and outputs when invoking multiple times. It might be easiest to add the test inputs and outputs folder to the container and swap the input for each interface to a single input folder and move the output to the outputs folder. Otherwise it's a headache with file permissions.

I don't think there is a clean way of including a test script for exec mode. It would just be confusing. If a user wants to revert to exec mode, they'll have to adjust the test script themselves.

@jmsmkn
Copy link
Copy Markdown
Member

jmsmkn commented Apr 15, 2026

It might be easiest to add the test inputs and outputs folder to the container and swap the input for each interface to a single input folder and move the output to the outputs folder.

In prod we do this with links from /input to the actual input location for each invocation, same with output.

I don't think there is a clean way of including a test script for exec mode. It would just be confusing. If a user wants to revert to exec mode, they'll have to adjust the test script themselves.

We should not offer templates or an option for exec mode, there is no good reason to use it over invoke.

@chrisvanrun
Copy link
Copy Markdown
Member

chrisvanrun commented Apr 16, 2026

The LABEL being used as switch finally had the 2 cents rolling down (or up!) on the way things are set up. =P

@amickan
Copy link
Copy Markdown
Contributor

amickan commented Apr 16, 2026

After this is merged, we might want to update the onboarding powerpoint as well as the documentation to reflect the new default.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Switch the templates to use the invocation API

4 participants